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This review presents various aspects of a mean-field spin glass model known as the p-spin spherical 
spin glass model, which has raised a lot of interest in the study of spin glasses, and also for its possible 
links with a mean-field theory of structural glasses. 

This preprint contains no new results and is therefore not intended to be published, but its aim 
is to present a collection of results and formulas concerning this very rich model. 

It is in fact the english translation of one of the chapters of my PhD thesis ( "Quelques aspects de 
la dynamique hors d'equilibre des verres de spin" , "Some aspects of the out of equilibrium dynamics 
of spin glasses"). A postscript version (in french) of this PhD thesis will soon be available at 



tittp:/ /www. lpt.ens.fr 



The recent developments in the theory of spin glass dynamics have made clearer the similarity of behaviour in spin 
glasses and in glasses [0J^]- In this context it seems at the moment that a certain category of spin glasses, those which 
are described by a so called one step replica symmetry breaking (RSB) transition || , are good candidate models for a 
mean field description of the glass phase . In these systems the presence of mctastable states generates a purely 
dynamical transition (which is supposed to be rounded in finite dimensional systems ^)-^|) at a temperature Td higher 
than the one obtained within a theory of static equilibrium, T s . 

The spherical p-spin spin glass introduced in pUq] is an interesting example of this category. It is a simple enough 
system in which the metastable states can be defined and studied by the TAP method 0. Besides, its relaxationnal 
Langevin dynamics was shown to display the interesting behaviour known as aging ]lfj| . 

The model is defined by the Hamiltonian 

H=— ^ ^ Ji 1 i 2 ---i p s ii s i2 ' ' ' s i P (1) 

l<il<i 2 -~<ip<N 

with p > 3, where the couplings are gaussian, with zero mean and variance p\/ (2N P ~ 1 ). The spins, instead of being 

restricted to the values +1 or —1 (Ising spins), are real variables, with the global constraint 5^2= i s i — N '■ the system 
is less frustrated, but this simplification allows for a more complete analytical treatment, and the model still displays 
a very interesting behaviour. 

In this small review are presented statical and dynamical aspects of this model. Numerous formulas are displayed 
in appendices. 

I. STATICS 
A. Replica method 

This study, made by Crisanti and Sommers 0, shows a transition at a temperature T s , between a high temperature 
replica symmetric phase, and a low temperature phase with one step of replica symmetry breaking (see appendix 
A.l) : at low temperature, the Boltzmann measure is dominated by a small number of pure states. 

The static transition temperature is given by : 

T s = y ff (l-y)?- 1 , (2) 

V 2 v 



where 



2 l-y + \ny 

- = -2j/— jz 7^— ■ (3) 

P v--y) 
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B. TAP equations 



The TAP (Thoulcss- Anderson-Palmer, Q) equations are equations on the local magnetizations m, = (sj). They 
were derived by Rieger [ p"2| for the p-spin model with Ising spins ; they can be derived through a variational principle 
on the m,, from a free energy / ({rrii}). In the spherical case, this free energy was obtained by various authors P^,ff3| ; 
in appendix A. 2 we propose another derivation by the cavity method ||. 

The free energy / ({rrii}) is best written in terms of radial and angular variables, q and Sj (with rm = s/q~§i), in the 
form Q : 

/({ m ,}) = g^°({si})-|ln(l-g)-i[(p-l)^-p^- 1 + l] ; (4) 



where the angular energy is 



E°({§i}) = ~ E J n iJif-K- ( 5 ) 

l<ii <•••<%, <JV 

At zero temperature the TAP states are just unit vectors which minimize the angular energy E°. There actually 
exist such states for E° G [E min ,E c = — y/2(p — l)/p] p3j . The states with E° = E rnin correspond to the RSB 
solution. 

We denote by sf one zero temperature state, of energy The free energy per spin / ({m,}) depends on the Sj 
only through E^- We see therefore that each state sf, gives rise at finite temperature T to one TAP state a given 
by: 



< = Vl(E° a ,T) S ? , (6) 



where q(E^,T) is given in appendix, equation (A31). 

When changing the temperature, one can follow the metastable states which keep the same angular direction (|^); 
their order in free energy or energy, at fixed T, is the same as their order in E° : if E^ > Ep, E a (T) > Ep(T). 

When raising T, a state disappears at a temperature T max (E°) (where the equation defining q(E^, T) has no more 
solutions) ; T max (E°) is a decreasing function of E° ; the most excited states, with E° = E c , disappear first at 
T m ax{E c ), and the lowest at T max (E m i n ) = Ttap- Above Ttap, the only remaining state is the paramagnetic one 
with q = and free energy F para = — 1/(4T). 

To complete the description of metastable states at any temperature, one only needs the density of states p(E°) 
with an angular energy E°. This has been computed in E3]; the multiplicity is exponentially large, giving a finite 
complexity density s®(E°), defined as : 

S o ( £0) =lim^l. (7) 

At finite temperature, for a free energy F between the free energy of the lowest (with E° = E m i n ) and the highest 
(with E° = E c ) TAP states, we have therefore an extensive value for S C (F, T), the logarithm of the number of TAP 
states with free energy / at temperature T. 

The equation (Q) gives the free energy of a TAP state with a given zero-temperature energy ; to obtain the full 
partition function, we need to sum over the possible energies, including the complexity term. After changing variables 
we obtain an integral over the free energies of the TAP states [[l3| : 

For large N we evaluate this integral by a saddle point method. For T > T*, with T* = yjp(p — 2)P~ 2 (p — 1) 1_ p/2, 
we find that the Boltzmann measure is dominated by the paramagnetic state q — 0, with F — NF para . On the 
contrary below T* , this measure is dominated by TAP states with free energy F eq ; because of their complexity, their 
total free energy is : 

F tot = -T\n{Z) = F eq (T) - TS C (F eq (T), T) . (9) 

For T <T S , these arc the lowest TAP states, with E° = E min , and, for T s < T < T* , intermediate TAP states with 
a parameter q given by : 
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JL<r'(l- g )=l. 



(10) 



In this region T$ < T < T* , F to t is equal to the paramagnetic free energy. The global situation is pictured in figure 
(0). 



Free energy 




FIG. 1. Free energy versus temperature; (1) : free energy of the paramagnetic solution for T > T* , F to t for T < T* ; 
(2) : free energy of the lowest TAP states, with zero temperature energy E m i n ; (3) : free energy of the highest TAP states, 
corresponding to E c ; (4) : an intermediate value of Eo leads to an intermediate value of / at any temperature; (5) : f eq (T); 
the difference between curves (5) and (1) gives the complexity TS C (f eq (T),T). 



Between the two transition temperatures T s and T^, the situation is unclear : the total equilibrium free energy 
seems to get two equal contributions, from the paramagnetic state and from a bunch of TAP solutions with non-zero 
q. One can wonder if there is a phase coexistence, or simply a problem of double counting in the TAP approach. This 
issue, which is an important one if one aims at understanding the finite dimensional behaviour of this type of systems 
P|, can in fact be clarified within a dynamical approach as. Let us also mention that some purely static approaches 
also carry relevant information on related issues fl4| , |l5|| . 

Before explaining this particular dynamical approach, we will recall the previously known results of the equilibrium 
and out of equilibrium dynamics. 



II. HIGH TEMPERATURE DYNAMICS 



Following the study of the statics Q, Crisanti, Horner and Sommers studied the Langevin relaxation dynamics of 
the model [@| 



dsi(t) dH , . . . . . 
-^ = -^7 -/*(*)*(*) 



(11) 



where fj,(t) has to be computed self consistently in order to implement the spherical constraint. Using the same 
formalism as Sompolinsky and Zippelius for the SK model, they wrote coupled equations for the correlation and 
response functions, with random initial conditions corresponding to a quench at initial time. 
If the validity of the fluctuation-dissipation theorem (FDT) 



^C(t,t') = -Tr{t,t% 



(12) 



and invariance by time translation (TTI) are assumed, the equations reduce to one single equation for the correlation 
C(t,t') = C eq (t-t') : 
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dC eq (r) 
dr 



(t-u) 



dC eq {u) 
du 



(13) 



with the initial condition C' eq (0) = 1 (see appendix B.3.b). These equation can be integrated numerically, with the 
following result (figure (Q)) : at high temperature. lim r _^oo C eq (r) — ; if the temperature is lowered, a plateau 
appears in the curve giving C eq (r) as a function of log(r), which length diverges at a certain temperature Td, given 
in appendix B.l. 

Moreover, for T > Td, with T — Td <C Td, it can be shown analytically || that the plateau is approached with a 
power law, q + constant t~ a , and the departure from the plateau is in q — constant' t b ; this behaviour is identical to 
the one of the density correlation function in the mode coupling theories concerning the glass transition (the analysis 
of Crisanti, Horner and Sommers j|| follows the lines of the discussion by Gotze on the glass transition fill). 




FIG. 2. Ceqir) as a 
T = 0.7, 0.65, 0.62, 
here q « 0.509034. 
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0.615, 0.613 : 
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of t : result of the numerical integration of equation equation (h3|) for p = 3, 
here Td = 0.612372. The horizontal line represents the limit lim T _ 00 C e9 (r) for T — Td, 



The value of Td is precisely equal to the temperature T* where appears the problem of double counting mentionncd 
earlier. Besides, the fact that Td is higher than the static transition temperature shows that the transition at Td is 
purely dynamical. Below Td the dynamics is no longer ergodic. and the validity of the equilibrium dynamics properties 
should not be assumed. 



III. OUT OF EQUILIBRIUM DYNAMICS 



The dynamics below Td was studied in 1993 by Cugliandolo and Kurchan Jl0| | , taking into account the finite initial 
time. The dynamical equations for the correlation and response functions are as follow (with t > t' , and random 
initial conditions ; a possible derivation of this equations is detained in B.2) : 

M(*) = f ds ^-CP~ 1 (t,s)r(t,s)+T 
dr(t,t') 



dt 

dC(t, t') 
dt 



-H(t)r(t, t') + J ds C P- 2 (t, s)r(t, s)r(s, t') 



-fi(t)C(t,t') + ^ I d8C^\t,a)r{j/,a) 
p(p-l) 



ds C p - 2 {t,s)r{t,s)C( Sl t'). 
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(14) 



At high temperature, the system ( |l4| ) reduces, via TTI and FDT, to the dynamics studied by Crisanti, Horner and 
Sommers, equation (|l3|), but, below T^, C(t,t') and r(t, t'jdepend on the two times. The dynamical equations can 
be partially solved by the separation ol two time regimes [jio) (see figure Q)) : 

• FDT regime : for finite time separations r = t — t', i.e. for r/t going to zero, the equilibrium dynamics 
properties are valid, and we obtain two functions Cfdt(t) and tfdt{t) related by FDT. The limit r — > oo 
yields lin^^oo Cfdt(t) = q, with the value of the parameter of the threshold TAP states for q (corresponding 
to E° = E c ). 

• aging regime : for t and t' going to infinity, without (t—t')/t — > 0, i.e. for widely separated times, one can neglect 

the time derivatives 9r ^f ^ , ^gf^ ' ; an d this yields equations invariant by time reparametrization. This way, 
an Ansatz can be found to solve the equations : C(t,t') = C(h(t')/h(t)), and r(t,t') = g(h(t')/h(t))h'(t')/h(t), 
with C(l) = q, and h a monotonously increasing function. Moreover, G(\) = xC'(X), with constant x. In this 
regime the correlation decreases from q to zero. 




0.01 0.1 1 10 100 

FIG. 3. p-spin model with p = 3 : C(t w + t,t w ) as a function of t at temperature T — 0.5 (Td ~ 0.612) for 
t w — 0, 10, 20, 30, 40, 50, in logarithmic scale ; this curves were obtained by numerical integration of the dynamical 
equations (|l4|), with the algorithm used by [15] ; the dotted curve is Cf dt (£) , the horizontal line corresponds to q at T = 0.5, 
q « 0.639. 

The energy density can be shown to approach asymptotically the energy density of the highest TAP states. As was 
noticed in this dynamics does not explore the TAP states which dominate the Boltzmann distribution, and in 
fact stays above all TAP states, with energy density going towards the one of the threshold states, but staying at all 
times O(l) above. 

IV. INFLUENCE OF INITIAL CONDITIONS 

Using the same field theoretical techniques as for the out of equilibrium dynamics, it is possible to derive dynamical 
equations for a system thermalizcd at temperature T 1 at the initial time, and then brought at temperature T. 
However, to implement the Boltzmann measure at T' for the initial conditions, one has to reintroduce replicas (see 
appendix B.3, and |l9|- ^l| , |l5| ) . The obtained equations describe the evolution of two times overlaps between replicas 
C ab (t,t') — < s a (t)s b (t') >, where a and b are replica indices. These equations respect the initial structure (replica 
symmetric or not) of the C ab , i.e. the static replica structure describing the equilibrium at temperature T". 
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For the p-spin model, the initial situation is replica symmetric if T' is higher than the static transition temperature, 
with C ah (0,0) = S a i,. Therefore, at all times we can write C ab (t,t') = C(t,t')S a b, and the equations are now (for 
T >T s ,t> t') : 

Kt) = f ds ^CP~\t, s)r(t, s) + T + ^C(t, 0) 

= -»(t)r(t, t') + £ ds C p ~ 2 (t, s)r(t, s)r(s, t>) 

+ p(p_l)_ r dsCP -2^ s y^ s ) C ( s ^ 
2 Jo 

+ ^ J C^ 1 (t,0)C(t',0). (15) 

We see that the only difference with the usual dynamical equations lie in terms of coupling to the initial condition. 
Of course, these terms vanish in the limit T" — > oo. 

a. T = T" If the temperature does not change at the initial time, T = T' , we start with a thermalized system, 
and do not modify it. Therefore the definition of the initial time is arbitrary and the system stays in equilibrium : 
the dynamics is equilibrium dynamics, with C(t,t') = C eq (t — t'), r(t,t') = r eq (t — t') and r eq (r) = — d ^ q . The 



equations (15) yield then equation ( |13| ) of equilibrium dynamics (see appendix B.3). 

For T > Td the system is in the paramagnetic state, with linv^oo C eq {r) = 0. On the other hand, below T^, we 
know that C eq (r) can not go to zero. We obtain lim T _»oo C eq (r) = Coo, where Coo is the highest solution of 

^C^ 2 (l-Coo) = l (16) 

obtained taking r — * oo with ^"q^ — > in the equation of equilibrium dynamics ([l3|). This equation is identical to 
(|Io|), which defines the Edwards Anderson parameter of a TAP solution. 

Therefore, below T^, the thermalized system is in a TAP state, and no more in a paramagnetic state : we would 
then have Coo = 0. The Boltzmann measure is neither a superposition of TAP states and a paramagnetic state, since 
the average on initial composante would yield an intermediate value for Coo ■ 

This shows that, for temperatures lower than T^, the Boltzmann measure is given by the bunch of TAP states with 
free energy F eq (T) such that 

F eq (T) - TS C (F eq (T), T) = F RS = -^. (17) 

b. T different from T' In order to push further the dynamical exploration of TAP states, we can now study the 
dynamics at a temperature T different from the thermalization temperature T". Two different scenarios are a priori 
possible : equations ( p"5| ) can yield an explicit dependence on t and t' for C(t,t') and r(t,t'), or, after a transient 
regime, equilibrium dynamics, with functions of t — t' . A numerical integration of the equations (using the algorithm 
of |T^,|l^]) leads to eliminate the first possibility (see figure (|I|)). 
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FIG. 4. p = 3 model, with T s « 0.586, T d w 0.612 ; numerical integration of equations (y) for T' = 0.605, T = 0.6 ; C(t,0) 
is shown as a function of t in full lines, C(t,t') as a function oit — t 1 for t' = 6, 12, 18, 24 (symbols) ; the dotted cu rve is the 
result of the numerical integration of (|l^), and the horizontal line represents the value of Coo obtained by (B27,B2c). 



To study analytically the behaviour of the system, it is therefore convenient to introduce as previously C eq (r), 
(t), related by FDT, as well as Coo = lim T _ >Q o Ceq{f), fioc — limt_>oo an d I = limt_>oo C(t, 0). I can differ 



from Coo because of the transient regime. We obtain 



dC eq (r) 
dr 



o ^7pJ C eq (r) 

du C^ _1 (m) r eq (r - u) 



2T 



CP 



2T' 



-l p . 



(18) 



It is possible to extract the value of Cqo ; the energy of the system can also be computed (appendix B.3.b). 

For T ^ 7 1 ', we obtain that the asymptotic energy Eqq, and Coo are precisely the energy and the parameter q of 
TAP states at temperature T : those are the TAP states obtained following the TAP states that are of equilibrium 
at temperature T' to the new temperature T : these states correspond to a certain angular energy E^, , and Coo is 
equal to q(E°,,T) (see figure (Eh). 
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Free energy 




Temperature 



FIG. 5. (1) : TAP states giving the statics at T' , with angular energy and q(E^> ,T") ; (2) : TAP states (1) followed 
at temperature T, with q(E^,,T) ; (3) : TAP states giving the statics at T, with angular energy E%, and q(E°,T). 



The obtained dynamics is therefore a relaxation in a TAP state, in which the system was thermalized, followed at 
the new temperature T. It differs from the TAP states dominating the statics at T. Moreover, taking the Laplace 
transform of (p"8|), it is possible to show that the relaxation of C eq {r) for large r is of the form t~ 3 / 2 cxp(— t/tq). The 
relaxation time To, which can be written as a function of T, T' and Coo (the exact expression is complicated, and I do 
not reproduce it here), diverges for the threshold TAP states (E° = E c ), and this relaxation occurs only for T lower 
than the temperature where the followed TAP state disappears. If T is further increased, we observe a fast relaxation 
in the paramagnetic state. 



V. CONCLUSIONS 



In this paper have been shown various aspects of the spherical p-spin model, which, despite its relative simplicity 
(it is a mean-field model, with a global spherical constraint instead of a constraint for each spin) that allows for an 
analytical treatment, displays a complex phase space and interesting dynamical behaviours. 

The phase space landscape is made of many metastable states whose caracteristics are given by the "TAP equations" , 
therefore called "TAP states" . 

The use of particular initial conditions for the dynamics has shown that these solutions of the TAP equations 
correspond to real states, with a real crgodicity breaking. Below the equilibrium measure is given by TAP states, 
the paramagnetic state vanishing at this dynamical transition. The way in which this state disappears is still an open 
question, whose answer would certainly help to understand the essence of the aging behaviour obtained with a quench 
below Td- 

Moreover, if the system is prepared in a TAP state, by a thermalization between T$ and Td, it stays trapped within, 
even if its temperature is changed : these states can be followed by the dynamics described in paragraph IV, as well 
for lower temperatures as for higher ones, and even for temperatures higher than Td, until they disappear. They 
present a true crgodicity breaking even at these temperatures, but their complexity is not high enough to allow them 
to contribute to the Boltzmann measure. The structure of these metastable states is still under investigation : in pifl 
for example, it is shown that they are not randomly distributed in the phase space. 

On the other hand, the usual dynamics at a temperature below Td, starting from a random configuration, only 
leads to a "weak ergodicity breaking" p^JlQ ], where the self overlap vanishes at very large time differences (much 
larger than the waiting time). This is explained [Io|j2^| by the fact that the system, which was initially in the (infinite 
temperature) paramagnetic state, does not find any TAP state in a finite time, but stays at energy density 0(1) 
(going to zero as t goes to infinity) above the threshold. 

It is likely that the impossibility for the system to find the states in a finite time results from the mean-field 
approximation, and that, in finite dimensions, the time to find these states would be finite, the dynamics being 



obtained afterwards by jumps between states. Recent numerical simulations of a model with 4 spins-interactions in 
three dimensions |25f| tend to support this scenario. 
Acknowledgments 
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APPENDIX A: THE STATICS 
1. Replicas 

The study of the p-spin model with the replica method yields the following results : 

• at high temperature, the system is replica symmetric, with Qea = (paramagnetic region) ; 

• below the static transition temperature 

Ts = vM (1-y)*" 1 , where I = -2 y l^±^ , (Al) 

V 2 y p (i - y y 

there is a one-step replica symmetry breaking, with parameters go = Oj <?i) an d free energy density 

Fuss = -± (1 - (1 - x)rf) + £ in ( J'T^ ) - | ^ - *0 (A2) 



and 



gr(i-«i) = J^r,x = T g rV-( i -i]- ( A 3) 
Vp \ p \y 



2. TAP solutions 

a. Derivation of the TAP equations 

We derive here the TAP equations on the local magnetizations, using the cavity method (3). 
The Hamiltonian is 

r ^ 

H = — y ] Ji 1 i 2 ---i p Si 1 s i 2 ' ' ' s i p ~ 2 ^ ] S i ( A 4) 

l<il<i2---<ip<A r 1 = 1 

where r is ajusted in a self consistent way to implement the spherical constraint. 

To the Hamiltonian for N spins i = 1, • • • ,N we add a spin so, with coupling constants Joi 2 --4 p - The field acting 
on So is 

h= ^2 J 0i 2 - --ipS'h ■ ■ 'Sip- ( A5 ) 

l<i 2 <-<i p <N 

In the absence of so, to each configuration of the s, correspond a value of /i. The probability distribution of this field 
in the absence of so will allow us to obtain the joint distribution of sq and h. The mean value of h is : 

( h ) N = J oi 2 -i P (s t2 ) N ---(s tp ) N (A6) 

l<i 3 <— <ip<JV 

since the Joi 3 ...» and the Sj are independant variables ; we have also used the hypothesis (si 2 ■ ■ ■ Si ) N f=a 
(si 2 ) N ■ ■ ■ (si ) N , so called "clustering" hypothesis m, more precisely 



^/FT Yl ((^■■■s lp ) N -(s l2 ) N ---(s lp ) N ) 2 = 0. (A7) 

Besides, in 



lim 

N->oo NP- 

ia— »p 



((h- (h) N ) 2 ) N = Y Joi 2 -i p Jok 2 -k p 

l<i 2 <---<i p <N,l<k 2 <---<k p <N 
((Si 2 ' • • Si - (S 42 ) N • • • (s tp ) JV )(Sfc 2 ' • • Sfc - (s fc2 ) N • • • (Sfc (A8) 
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the terms such that {12, ■ • • , i p } = {^2, ■ • • , k p } dominate, and 

{{h-{h) N f) N = P -{l- q v- 1 ). (A9) 

It is possible to show (calculating higher moments) to show that the distribution of h in the absence of Sq is gaussian. 
In the rpesence of so, we add an interaction hso, so the joint distribution of h and sq is of the form 

P N+ i(h, s ) <x exp (-^sl + phs - • (A10) 

We deduce 

*o) N+1 = (All) 



r 



and 



((■so - (so) N+1 ) 2 ) N+1 = m — -. (A12) 

p(r - ^(1 - qP 1 )) 

Because of the spherical constraint, ((s — (so) n +i) 2 )n+i = 1 — <?, so that : 

1 p(3 2 

f3r = + ^-(1 - q?- 1 ). (A13) 

1 — q 2 

We need equations between the {si) N+1 , therefore we must obtain (h) N as a function of these magnetizations. In 
order to do this, we look at the influence on (sj) of the new spin so, for a given i. We write 

h = Sihi + h'i (A14) 

where 

hi = y ] Joii 3 — i p s i 3 ' " " s i p i (A15) 

l<i 3 <—<ip<N 

the sum being on indices non equal to i. Then hi is of order TV -1 / 2 , and to leading order 

((hi-(hi) N f) N =^^(l- q ^) 

m-(h' l ) N ) 2 ) N =p-q p - 1 ) (A16) 
so the joint probability distribution of so, Sj, hi, h\ is 

{hi-{hi) N f {K~{K) N f 



PN+i(so,Si,hi,h'i) oc exp —N 



p(p - 1)(1 - qP-i) pil-qP- 1 ) 
~^sl + Pso&hi + h>) - ^^f ) ■ (A17) 

(Si — lSi) ) 2 . . 

The term — l ^(i-q) — com es from the fact that, in the absence of So, the spin Sj has average (si) N and variance 1 — q. 
Integrating out hi, h! i yields 

P N+1 (s , Si ) (x exp + ^(1 - q^sl + Ps ( Si {hi) N + {h' t ) N ) ^i-gf ) ' ^ 



anf finally with (A.13) : 

(*i>x+. = (s t ) N +P 2 (l-q) 2 (h l ) N (h' l ) N (A19) 
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{si) N+1 ^ (si) N + (3(1- q)(so) N+1 J 0ii 3 -ip(si3)iv---( s ip)w ( A2 °) 

l<i 3 <--<ip<JV 

The technique used by Riegcr |0| allows to write the TAP equations on m, = (si) N+1 , i = 0, • ■ • , N : as 



m 



- q) 

A V H > l<i 2 <-<i p <N 



S l2 ) N ( S ip) N 1 

(A21) 



we obtain 

mo 



- q) 

MV y/ l<i2<— <i=<JV 



X] -A),,...,. '»,., • ■ -TOj p - A, (A22) 



where 



A = (p - - g)m ^2 Joi 2 -i p m i2 ■ ■ ■m ip ^ J 0l2k3 ... kp m k3 ■ ■ ■ m kp , (A23) 

l<i2<— <i p <JV l<fe 3 <"-<fc p <Af 

and, using the coupling symmetry under permutations : 



A=(p- 1)(3(1 - q)m Q ^ ^ Jo» 2 -i„TOj 2 • • • ^ Joi 2 k 3 -k p m k3 ■ ■ ■ m kf , 

= P(l-q)m -, _ 1 ,, 2 ^ ( ^ Joi 2 k 3 -k p m k3 ■■■m kp I . (A24) 
The terms Joi 2k3 ... kp nT^ 3 • ■ 'TO^ p are dominant and yield : 

The equations are finally : 

2^ Joi 2 ...i p m i2 • ■ ■ m ip - (3(1 - q) q p m . (A26) 



/3d - «> x< i2 <t^ 



<7V 



6. Study of the TAP states 

The states a are given by 



mf = V?(^S,T)S? , (A27) 
where q(E,T) is obtained by minimizing the free energy 

q %E-^Ml-q)-j T l(p-l) q P-pqP- 1 + l] ; (A28) 

if we take 



*=I(l-g)gf-l (A29) 



we obtain the equation 
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2 

which yields that q is the largest solution of 



P( - P 1 K 2 +pzE+l = 0, (A30) 



(1 - = T ( ~ E ~^l~ El ) , (A3D 



with E c = —y / 2(p — l)/p (the other solution is not a minimum of the free energie ( |A28 )) 



The maximum of (1 — q)q' p ^ 2 1 occurs for q = 1 — |, so that the equation ( | A3 1| ) has no more solutions when 

(A32) 



2 (i 2 V~ 1 _ T ( - E -V W ^M 
p\pj \ p- 1 



Therefore, a TAP state of energy E° disappears at 



^-'"D U-^-j ('-;)'"'■ (A33) 



The energy per spin of a state a, given by ^gfi, is : 

£ Q = <zf £° - -jp [(p - l)flS - P9T 1 + 1] • (A34) 
The number of TAP states with angular energy E° is exponential in N, and the complexity is |fl3f : 

n, n, 1 / P^ 2 »— 1, 2 2-p\ , 



with z = y—E° — yj (E ) 2 — E% \ /{p— 1). This complexity goes to zero for 

v 



(A36) 



which corresponds to E° = E m i n = Ersb{T = 0). Therefore there exist TAP states for zero teperature energies 
between E min and E c . 

The lowest states disappear at 

T T Ar = -Jir • ( A37 ) 



p\ 2y \ p 

Let us now determine the parameters of the TAP states dominating the partition function. They minimize 

F tot = -Tln(Z) = i^(T) - TS C (F eq (T), T) , (A38) 

so that 

Mi - «) - ^[(p - i)? p - m" -1 + 1] 

T / pz 2 p - 1 2 2 2 - p 



hl -Tr + -^ z -Z^ + — JL )- ( A39 ) 



Taking the derivative with respect to q, using the relation p ^ p 2 ^ z 2 +pzE° + 1 = 0, substituing z with its expression 



2 

function of q, and taking 
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(A40) 



we obtain 



(l-ar)((p-l)(l 



q)x-l)=0, 



(A41) 



which yields : 



P 



(1 - q)^- 2 = 1 



(A42) 



2T 2 



or 



Kg - 1) 
2T 2 



(1 - qfq 



1. 



(A43) 



The first solution yields a free energy density equal to — 1/(4T), i.e.. equal to the free energy density of the 
paramagnetic solution. Moreover : 



Given that (1 — q)q p 2 is maximum for q = {p — 2)/{p— 1), this solution is only possible for temperatures lower than 
T* , with 



Above T* , the paramagnetic solution with q = is therefore dominant. For T = T$, q goes to the value q\ of 
the lowest TAP states Below T$ there is no more any solution, and these states, with the lowest total free energy, 
dominate. 

The second solution corresponds to the threshold states, and is valid only for T = T* ; for any other value of T it 
does not yield the lowest free energy. 




(A44) 




(A45) 
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APPENDIX B: DYNAMICS OF THE P-SPIN SPHERICAL MODEL 



1. Dynamical transition 

The dynamical transition temperature can be obtained by the dynamical stability criterion : the correlation function 
is a decreasing function of the time 9C "g^ < 0. This criterion, together with the evolution equation of C eq (fl3|), 
commands that, at all times, 

- TC eq {r) - JLcI-^t^C^t) - 1) < 0. (Bl) 
It is now easy to check that this inequality cannot be satisfied for all times, if lim r ^oo C eq {r) — 0, below Td, with 

_ / p(p -2)P~2 
Td -V2(p-l) P -- (B2) 



2. Dynamical equations 



The starting point of the formalism is the equality 

N 



1= y , ^s 1 ---P Sw ^f[5^^. t (t) + |^+ M (i)^(t)-^(t)^ , (B3) 

which is simply a rewriting of the Langevin equation (the corresponding Jacobian is 1 if the Ito discretization scheme 
is used for the Langevin equation, i.e. if Si(t + St) = Sj(t) — St^j-(t) — Stfi(t)si(t) + J t * +A * r)i(t')dt'). 

The notation T>Si stands for Y\t dsi (t) : at each time t the integration is performed over all possible values of the 
spins. 

Writing T>sDs for T>s\ ■ ■ ■ Ds^Dsi ■ ■ ■ T>§n we obtain : 

1 = J PsPsexp \J2j Q ^i(t) ^(i) + |^ +n(t) Si (t) -m (t)j\ . (B4) 
This equality can be averaged over the noise : 

1 = J VsVscxp (j2j o dt (jSitt) + Si(t)si(t) + ■ + p(f)*i(*)*i(*))l , (B5) 

and then over the quenched disorder, using 



dH 



we note 



^ ] Jii2—ip + ^ ] Ji 2 ii3---i P + ' ' ' + ^ ] Jizis---ipi I s »2 ' ' ' s i P ! (B6) 

. i<*2-"<ip »2<*<«3-"<*p i2<-"<*p<* 



E= E + E +•••+ E . ( B7 ) 

i i<i2---<i P iz<i<i3"-<ip i2<-<ip<i 



and similarly the sum X^ 3 -<i with indices ik different from i and from j : 
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1=1 VsVs exp S 

S = J2 dt (Tsf(t) + Si(t)si(t) + n(t)Si(t)8i(t)) 

I / N * poo poo 

— (EE/ dt J o ^MWO^KW (*0 



p! 



4iVP 

N * /.OO /*oo 



JY pOC poo 

12 J Q dt J *'«<(t)«<(* / )aj(*)aj(* / )*i3(*)*i8(*')-"«<p(tK(0 



(B8) 



By definition of the correlation and response functions, these quantities are given by the average of Si(t)si(t') and 
Si(t)si(t') with the action S. Taking the limit N — > oo, we will therefore be able to write in a self consistent way : 

l5>(t) Si (t') = C( M ') ; -Lj2s>m(t')=r(t,t>), (B9) 

i i 

which is equivalent to using the saddle point method. Besides, for N — > oo, i Y2i Si(t)si(t') = (it is a double 
derivative of 1 with respect to r)i(t) and r)i(t')). 
We then use : 

, . dS , , (9^4 , ,. , 

<W - ''im 1 (B10) 

with A = Si(t') and A = s,(i') ; 
dS 



dSi(t) 



2Tsi{t) + Si(t) + ii(t)8i(t) 

pOO * 

T / dt / ai(OSa*.(*K(* / )"'*<p(*K(*') 



p! 



I /-oo ^ 

^ y o £ #j(< , )E j f.( i ) j f»(0"'«i,( t K( < '). ( Bi1 ) 



2iV*> 

We multiply by Sj(t'), and sum over i ; in the limit AT — > oo we obtain : 

= - 2Tr(t', t) + + li{t)C(t, t') 



P " 



2 7o 

p(p-l) /■* 



di"r(t / ,t")C(*.*") p ~ 1 

dt"C(t', t")r(t, t")C(t, t") p - 2 (B12) 



(with r(t',t) = for t > t'). 

In the same way, multiplying by Sj(i') and summing over i yields the equation for r. Taking the limit t' —* t, with 
C(t,t) = 1, yields then the self consistency equation for fx(t). 

The energy is obtained multiplying (|TT| ) by Sj(t'), averaging over the noise r\i and the couplings, and finally taking 
the limit t' — > t : 

£ siW&i® = -j2 si(t')^: (t) m J2 siVMt) + £ (Bi3) 



and, with (B6) 



1 r) 
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so, with ]im t ,^ t d t C(t,t') = -T : 



T - u(t) 

E(t) = — . (B15) 



P 



3. Thermalized initial conditions 

a. Dynamical equations 



In the previous derivation, the average over the initial conditions Si(0) was not performed, since the system was 
taken disordered at t = 0. This average is therefore uniform. 

If on the other hand the initial system is thermalized at a given temperature T", this average is 

f -H[ Si (0)]/T' 

J Vs(0) , (B16) 

where Z(T') is the partition function at T". As we want to average over the couplings, we have to reintroduce replicas : 

ZW r ) = ^j ^■■■^ n - 1 e^(-^H[st]\ . (B17) 

We introduce at all times n replicas, with the same disorder realization. The spins are now s°(i) with i = 1, • ■ • ,N, 
a = 1, ■ • ■ , n. We obtain after averaging over the noise 

/n 
Vs a Vs a exp^5} 
a=l 

sa ' = E J Q dt§ i& [ T % (*) + *? (*) + + (*)J - iv ( B18 ) 



After the average over the couplings, we have the same terms as in (B8), with a sum over replica indices, and the 
following new terms : 



* />OC 

lEEE / ^(*)«J(0K(t)«t(0)- (0). (B19) 



1 p! 

i<b i i 



Taking the derivative with respect to s"(i), multiplying by s|(t') or s b (t'), and summing over z, we obtain for 
N — » oo equations for C ab (t, t 1 ) and r ah (i, i'), with r oh (i, i') = 5 a br(t, t') since the replicas are not coupled. The terms 
( B19Q give rise to a coupling to the initial conditions C ab (t,0) and C ab (t',0). We thus obtain equations which, in the 



RS case, reduce to (|15| 

b. Case T=T' 

The system is FDT and TTI : C(t,tf) = C eq (t-t'), r(t,t') = r eq (t-t') ; we note r =t-t' ; then r eq {r) = -y^p 
The integral appearing in the equation for n(t) is : 

p 2 r* r^-xu _s 1 p 2 r* ... P 

so that 



^ d S C^sMM) = J d U C^u^M = -^(C* (*) - 1) (B20) 



= T — ^(C* (t) 1) + ^C* (t) = T + ^. (B21) 
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For the equation for the correlation, the first integral is 

ds &-\t, s)r(t', s)= [ ds CP-^t - s)r eq {t' - s) = ~ I du C^T 1 (u)CUu - r), (B22) 



10 jo 
and the second one yields 



(p-1) / ds C p - 2 (t, S )r(t,s)C(s,t') = (p-1) / ds Cl7 2 (t-s)r eq {t-s)C eq {t' -s) 



n 



T 



i 

1 duCl- 2 (u)C' eq {u)C eq {u-T) 



+ (p - 1) / rfs C*- 2 (t - s)r eq (t - s)C eq (s - t') 
p-1 



duCP q 2 (u)C' eq (u)C Eq (r-u) 
and, after integarting by parts : 

- i (^(tOC?- 1 ^) - Ce,(r)) + ±J du Cl-\u)C' eq {u - T ) - I jT du G%\t - u)C' eq {u). (B23) 
We finally obtain 

d -%r = ( T + h) Ceq{T) h ( c «V)c£Ht) - c eq (r)) 

~"r[ du CPe " 1{T " u)C " eq(u) + h c ^ 1{t)Ceq{t ' 1 (B24) 

which is equation (|l3|). 

Remark : it is possible to treat in the same way the equation for the response function ; this yields the derivative 
of JT3| ) with respect to r. 

c. T different from T' 

For T different from T', there is a transient regime. We therefore take t and t' large, i.e. the one-time quantities 
have reached their limiting values : 

C(t,0) = C(t',0) = I 

^t)=^ 00 =T+^(l-C^) + ^F. (B25) 

The equation ( p!q ) is obtained in the same way as for T — T' . The limit r — > oo yields 

= - (hoc ^) Coo - ^C*- 1 ^ - 1) - + JLp, (B26) 



or 



TCo. = - Coo) + ^CST'd - Coo) 2 - (B27) 



2T' 2T 

Taking the limit of i going to infinity in the equation for C(t, t') with t' = (|l^), we obtain 



= -/W + 



-Hod - ^ (CST 1 - 1) + ^F- 1 
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and finally : 



P~ 2 = 



ITT' 



P(l - Coo) 



(B28) 



Let us consider the TAP states that dominate the partition function at T' ; we note 

q = q(E° T ,,T) et qi =q(E°„T')- (B29) 



Equations (A42) and (A31) show that q and qi verify : 



^<7i (1 - ft) = 1, -^<? 2 = ^ ft . 



so that 



ft = 1-^(1 -9) V" 2 



T' 



(B30) 



(B31) 



If we now take A = 1 — ^fWfd — Cx^C^, 2 , the equation for (coming from (B27) and ( B28| )) can be written 

-l/(p-2) 



A' 



1 - A 



T /2/(p-2) _ q 



therefore A = gi and : 



= q(E°„T). 



(B32) 



(B33) 



The energy is QB15D 



7 1 - Mc 



1 



/" 



00 ~ p - 2T [ 00 j 2T" 
(remark that for T = T', we get back, with I = Coo, Eoo = — i.e. : 



1 



p(l - Coo) 2T 2T 
the energy at T of the TAP states dominating the statics at T" is : 

E{E° T ,,T) = qlE Q T , - ((p - l)q p - PQ p - X + l) 



which is identical to ( B35 ) (this identity is obtained using ( B31 ) and ( A44 )) : 

-Eoo E(E^,,,T). 



(B34) 



(B35) 



(B36) 



(B37) 
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